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ABSTRACT 

The evaluation report is one of seven produced for 
the Occupational Exploration Program (OEP) , a series of simulated 
occupational experiences designed for junior high school students. 
Describing the pilot testing of the simulation dealing with health 
and welfare, the report contains sections describing the simulation 
context, evaluation procedures, results, and a Reviser's Information 
SuBoary (RIS) • In the simulation, students assumed the 
responsibilities of health and welfare workers in a drug treatment 
center. The occupational roles included one director, physician, 
psychologist, medical technician, pharmacologist, nurse, probation 
officer, and social workers. The experimental design involved two 
Colorado schools, with a total of four experimental and four control 
groups involving 73 eighth and ninth graders. Instrumentation 
included knowledge and affective testing, student and teacher 
questionnaires, and a panel review. Analysis of variance and other 
descriptive statistics were employed, and reliability estimates were 
calculated. Analysis of variance results revealed that the simulation 
had a positive impact on student occupational knowledge. No 
statistically significant results or changes in occupational 
preference were noted. The RIS records and extrapolates trends 
related to the strengths, weaknesses, and recoqfaendations from all 
data sources. Appended materials include the evaluation instruments 
used and an observer form. (HH) 



U$.OeM«tMCHTOFMC*tTM. 

COUCAtlOH oppRO 



THE HEALTH AND WELPABE MODULE '^^f^^^'^o^^^^^^ 
AN EVALUATION REPORT FOR THK ll-"o%??^^^^^^^^^ 
OCCUPATIONAL EXPLORATION IROGRAM .education p 



Rrepared By- 
James Altschuld 
Janice Lave 
Roger Brown 



With the Assistance of 

Norman Singer Robert Cotman 

Brian Fitch Sandra Pritz 

Arthur Terry Jackie Lechner 

Michael Crowe Thomas Loyfcon 

Robert Caaipbell Robert Blum (Jefferson County^ 

Colorado) 
John Radloff (Jefferson County^ 
Colorado) 



THE CENTER FOR VOCATIONAL EDUCATION 
THE OHIO STATE UNIVERSITY 



September, 197I* 



PFHWlSStON TO REPRODUCE IMIS COPV- 
nS MAieR-AL HAS BEEN GRANTED OV 

to ER.C AND ORGANlWlOMS OPERAfING 
i?,DER AGREEMEMlSV.nH IhE «AI.0NAI .N 

OUCTION OUTSIDE IhE ^^'^ ^1^^*^*^., "\ 
SjiRES PERWSSSIOM of the COPYRIGHT 

OWMER 



ABSTRACT ' " / " • " ' 

HEALTH AMD WELFARE 
EVALUATIO?? REPORT FOR TIIE OCCUPATIONAL EXPLORATION PROGRAM 
3y: Janes W. Altschuld; Janice Lave; Roger Bro^m * 



This report is one of seven evaluation reports produced for the Occupational 
E^qploration Prograxi. The Occiipational Exploration Program (O.E.P.) is 
funded by the National Institute of Education and is a joint development 
effort of The Center for Vocational Education (The Ohio State University) 
and the Jefferson County, Colorado piiblic schools. O.E^P. is a series of 
experiences designed to provide junior high school students with the oppor- 
tunity to explore occupations. One of the major vehicles for exploration 
is the simulation technique. In 'FY^ 197^, 12 simulations \Teve developed 
and seven of those 12 were pilot tested. This report describes the pilot 
testing of the simulation dealing with health and welfare. The report 
contains section describing simulation context, evaluation procedures, 
restilts and aRevisor*s Information Summary (RIS). The RIS is useful for a 
variety of purposes and includes the strengths of the simulation as well 
as its weaknesses. Below is a synopsis of the specific content of the 
report. 

SIMDIATIOH C0KT5XT ; The participants in this simulation are introduced to 
some of the issues in the health and welfare field, and the roles and respon 
sibilities of health and welfare workers in a drug treatment center. The 
•students work in their various roles solving the problems of clients. For 
instance, the psychologist studies case histories and notes infonsation 
needed to work effectively \rith other staff; the medical doctor diagnoses 
clients* illnesses and determines if additional lab tests are needed. In 
the culminating activity, the center staff prepare and deliver statements 
supporting the operation of the drug treatment center at a city council 
meeting. The occitpational roles include one director, physician, psycholo- 
gist, medical technician, pharmacologist, nurse, probation officer, and 
social wrkers. EXPERE-EITAL DESIGN : For evaluating this simulation, I^- 
schools, tvio from Jefx'erson County, Colorado and two from Denver, Colorado 
were used, each school having one experimental and one control group. A 
teacher facilitated the implementation of the simulation \7±th each experi- 
mental £prcup. The exj, ^rimental and control groups consisted of 8th and 
9th graders; 30 students in the four experimental groups and k3 students in 
the four control groups. A modified laboratory or quasi-experimental 
setting was utilized for product tryout. EISTRUIffillTATION : A 32 item 
multiple choice knowledge test, "VHiat Do You Know?" and a 6 item affective 
test, "\^hat Do You Like?'', were administered as pre- and posttests measuring 
student laiowledge gain and attitudinal change. The student post-module 
questionnaire, "What Do You Think?", administered to the experimental group 
after conipletion of the simulation, is^iasured student perceptions of the 
module. Two teacher questionnaires and two panel reviews (mid- and post) 
were designed to obtain teacher perceptions of the simulation. Observers 
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were utilised to collect additional information about module iinplemen- 
tation* Ai l/iLYSIS : The Icno^.rledge test and afrcctive tost re^j^ats vere 
derived thrcu^h analyses of variance. Other descriptive statistics were 
employed where approprictbe (i.e., frequency, porcer^tage, percent chanse). 
Reliability estimates verc calculated to obtain the internal consistency 
est:LTi23.tes of the knowledge test and to determine inter-codcr and intra- 
codcr agreement for the attitude scale. RESULTS: The MOVA results reveal 
that the simulation had a positive impact on student knovledce in the 
health and welfare field (p^.Ol); althov^h shifts were noted in student 
occiipational preferences, the changes were not statistically significant. 
In general, the simulation v.^s well received by students and teachers as 
indicated from the strong positive trends which emerged from the question- 
naires. THB KET/ISOR^S nrOPi'-yiTION SUIS-IAir/ : The HIS was designed to not 
Only assist revisors to assimilate information collected duidng the pilot- 
test, but also as a unique way of smiiarizing the data* The summary is a 
record of the strengths, weal^esses and recommendations for revisors from 
all data sources (i.e., student tests, student questionnaires, observer 
fonns, teacher questionnaires, etc.). Trends have been extrapolated which 
list the most apparent streng-bhs and Trealcnesses of the simulation as well 
as recommendations to be considered in the revision of the simulation. 
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grant from the National Institute of Education, Department of Health, 
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Health and We If axe 

!• Brief Description of the Module 

The Health and Welfare module consists of a preview,* a preparation 
section, and four major tasks or activities. The preview consists of a 
two part slide-tape presentation: Part I is a general introduction to 
health and welfare designed to introduce the students to issues in the 
field; in Part II the basic elements of the siiaulation drug treatment 
center and the role of its workers are introduced. The first slide-tape 
explains the need for personnel to become involved with the health and 
welfare of individuals. In the second part, the drug treatment center is 
presented as an example of health and welfare workers joining together to 
aid people who need their assistance. The students are introduced to eight 
different occupations of people who work at the drug treatment center. 
These are: the director of the center, medical doctor, psychologist, 
medical technician, pharmacologist, nurse, probation officer and social 
case worker. At the conclusion of the preview, the students are asked to 
decide if they would like to continue in the module. (The option of not 
participating may not have been possible in the pilot test.) The preview 
is designed for two class periods. 

If the students decide to continue in the simulation eustivity, they 
enter the Preparation segment of the module. In order to aid the students 
in selection of their roles, the Preparation Handbook /'what Job Do You 
Want?", describes the roles. After reading the job descriptions, the 
students complete the job aptitude form, use the overlay to categorize 

*Papior to the preview, the students have seen a slide-tape and/or a 
booklet entitled Introduction to Simulation. 
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their Job preference and complete the Job preference profile. Students 
who would like to be director of the center indicate their desire at this 
time. The director is chosen by the drawing of lots ffom those students 
who expressed preference for the role. The preparation section is 
scheduled to last one class period. 

In Task 1, Staffing the Center » the students reaA the general tasks 
handbook, view the videotape entitled "Interviewing", and complete Job 
applications for positions other than director of th3 drug t^reatment 
center. The director then reviews the applications, interviews candidates 
for the position, and selects the personnel for the center. Task 1 is 
designed to last one to two class periods. 

In Task 2, People Who Come to the Center , the importance of coopera* 
tion among staff members and the effective heuidling of the cases of people 
who come to the treatment center for help is stressed. After pflurticipaats 
read the Task 2 Handbook, the director organizes the center's first staff 
meeting. Items on the meeting's eigenda include staff introductions, the 
assignment of case loads to various staff members, and the discussion of 
the three case histories. Task 2 is scheduled to last one class period. 

In Task 3, 'Vorking Together to Help Beople ", the participants work 
alone or in consultation with other members of the Center in solving of 
the problems described in each case history. Each meinber of the staff 
reauls th3 Task 3 Handbook and his specific role handbook. The role hand- 
book provides the participants with their assignment for Task 3* In this 
task, the director is responsible for coordinating the efforts of the 
staff at the center and answering letters from members of the comm[i;jiity 
who are displeased with the center in their neighborhood. The case 
worker is assigned to wi»ite a case history of Norman from the tape pro- 
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vided in the module. The probation officer makes decisions concerning 
Norman's problems, completes necesseury legal forms and serves as a con- 
sulteuit on other cases. The psychologist stiadies the case histories and 
notes the information needed to work effectively with the client or other 
staff members. The medical doctor diagnoses client illnesses and 
determines if additional lab tests are needed after studying symptoms 
given in case histories • The medical technician grows a bacteria culture 
ar^ U8es prepare'^ slides to compare abnormal blood cells to normal blood 
cells. The phemnaacologist conducts experiments and analyzes unknown 
quantities of dinigs to determine the type of drug potentially ingested 
by the patient. The nurse transfers information from case histories to 
medical record forms, orders lab tests, records lab results, and obtains 
additional medical histories of clients by corresponding with other 
medical clinics. Task 3 was designed to last for two to three class periods • 

In the Task k Handbook "Community Relations *', the participants are 
made awetre of citizens' petitions sent to city council about closing the 
drug treatment center. The staff of the center prepares statements 
supporting the center's operation. These statements are later presented 
before the city council's public hearing. Depending upon the availability 
of students ♦ either students who did not participate in the module's acti- 
vities or teachers who implemented the simulation played the role of the 
council. At the puclic heCLPing, the council decides whether to keep the 
center open. Their decision is based on the effectivness of the center's 
staff presentations. Task h is designed to last two class periods. 

The overall length of this simulation is approximately 10-12 periods 
of regular classroom time, i.e., about k5 minutes per period* 
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II. Description of Evaluation Procedures Employed 
A. Specific Sample Used 

1. S chools - For this module two Jefferson County and two Denver 
schools were used. In each school there was one experimental 
and one control group. The schools and the teachers were 
selected via discussion with administrators and teachers In 
each of the districts. A brief description* of the schools 
follows , 

Alameda Junior High School (Grades 7*9) > Jefferson County > 
Alameda Junior High School is n small school with approxi- 
mately 700 students in grades seven through nine. It seems to 
have a fairly stable school population in that school records 
indicate that over seventy percent (72^) of the ninth grade 
population have been in this particular school for threer consecu- 
tive years. Additionally, very few of the ninth graders have 
attended more than two elementary schools. Lorge-Thorndike tests 
administered at the school indicate a fairly normal distribution 
of student ability. The distribution of parental occupations 
shows that ^8 percent of the mothers are working and that almost 

percent of the fathers are in managerial, professional, or 
skilled positions. The school population is primarily Caucasian 
(93 percent) with the remaining seven percent coming from other 
minority groups. 

^Descriptions were obtained by John Radloff of the Jefferson County project staff. 
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Wheat Ridge Junior High School (Grades 7-9) » Jefferson County # 
Wheat Ridge Junior High School is a small school with 
approximately 725 students in grades 7-9. Twenty students are 
classified as mentally retarded. Generally, the school draws its 
student body from a middxw class, blue collar area. About 30 
students come ftrom families receiving Aid to Dependent Children 
(ADC) and many students are from divorced homes ♦ The area of 
Jeff Co. represented by this school has many older single family 
houses. There is a sizeable retired subgroup within the area 
population. The students are primarily white (^93^) wlth^the rest 
{^7%) having Spanish surnames. The school reports that standard- 
ized test results indicate that school scores are improving and that 
it is either at or above district norms in most CMes. 
Hamilton Junior High School (Crades 7-9), Denver ♦ 
Hamilton Junior High School is a large school with approximately 
1,600 students enj'oUed in grades seven through nine. The area 
served by the school is quite large and over sixty percent of the 
students at Hamilton are bussed in each day# The students generally 
come from the middle income range but there are some students from 
upper income areas. Student achievement seems to be relatively high 
(According to the assistant principal, over half of the seventh 
grade students maintain a B or higher academic average^) The racial 
make-up of the school is estimated to be 80 percent Caucasian and 
about 20 percent in minority groups. Further specification of the 
population was n6t available for this school* 
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Lake Junior High School CGrodes 7-9) » Denver » 
Lake is a large Denver junior high school with well over a 
thousand students* Although demographic data was not available 
at the time of this writing several factors about the school 
are known • First, it has a sizeable percentage of students with 
Spanish surnames • Secondly, in general Lake has a high rate of 
absenteeism^ (As soon as additional data becomes available, it 
will be appended to this report.) 



2» Teachers 

In each of the four schools, one teacher implemented the module with 
the experimental group of students. The following table contains a brief 
description of the experimental group teachers and the method by which 
they participated in the study. 



Description of Experimental Teachers 





Alameda 


Wheat Ridge 


Hamilton 


Lake 


Sex 


Male 


Female 


Female 


Male 


Subject 
Area 

Specialty 


Social 
Studies 


Counselor 


Unknown 


Social 
Studies 


Had prior 
experience 
with sim- 
ulation 
techniques 


Yes 


No 


Yes 


Yes 


Participa- 
tion 

selected / 
or volun- 
*g^"^ed 


Selected 


Volunteered 


Selected 


Volunteered 
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3. Students 

The following table reveals the sample size of students participating 
in the experimental and control groups by school and by sex. The results 
shov that the sex ratio was nearly equal for the experimental group 
wiiereas males v^ere in somewhat greater proportion in the control group. 

r-requency^ of Experimental and Jontrol Participanos by School and Sex 





Alameda 1 


Wheat Ridge 


Hamilton 


Lais 


.e 


Total 






Experi- 
mental 


1 

Control 


Experi- 
mental 


Control 


Experi- 
mental 


Control 


Experi- 
mental 


Cont J ol 


Experi- 
mental 


Control 




2 


3 


7 


7 


2 


7 


3 


9 


Ik 


26 


Femaaes 


7 


6 


2 


6 


5 


3 


2 


2 


16 


17 


Total 


9 

L 


9 


9 


13 


7 


10 


5 


11 


30 


h3 



The rre^iuency is based on participants with complete pre-posttest data. 

The experimental group participants were selected or volunteered fl'om 
the following classes: Alameda - eighth grade students were 4>elected from a 
language arts class; Wheat Ridge - eighth grade students volunteered from an 
English and a Math class; Hamilton - ninth grade students volunteered from a 
study hall; and Lake - ninth grade students were selected from a social 
studies class. 

At Alameda, the teacher described the group as having some slow readers, 
short attention spans and absenteeism. He felt the students had trouble 
reading directions and staying with the task» 

At Wheat Ridge, the teacher indicated one half of the class had excellent 
reading and verbal skills while one half did not. However, despite the 



ERLC 

hninniimrn'iaaaiia 



14 



8 



differences in reading ability, all students worked well 

together and began to like students with different ability levels than 

their own. 

At Hamilton, the teacher indicated that all the students were good 
readers and most were outgoing. 

At Lake Jr. High, the teacher described students as being highly 
v*^rbal and well motivated and 3 students as having low ability. The 
teacher felt the group did not function as a unit* The three low-ability 
students accomplished the tasks independently and were ill at ease with 
others in the group. 

The method by which the control groups were obtained is not totally 
clear. In the testing of k modules in the Spring of 197^ it was not 
feasible* for one individual to administer the tests. Therefore in each 
school either the experimental group teacher or another educator selected 
and administered the tests to e control group. It was stiggested that testers 
try to select or sample students similar to those in the experimental group, 
i.e., if the experimental group was an English class then the tester was 
instructed to obtain a second English cleiss for the control group. It is 
assumed that, to the extent possible, these directions were carried out. 

In summary, the sampling was far ftrom ideal. It was impossible to 
conduct more systematic sampling due to progrcun and organizational constraints 
within buildings. It should be noted that experimental results are based 
only on students who completed both the pre- and posttest. There was sarople 
loss in the testing of the module as described in the following table. 

*The time and monetary allocations for the pilot test precluded the use of 
extensive checks on the sampling procedure in the field. 
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JTequency and Percent of Sample Loss by Group 





Original Total 


Sample Loss 


Percent of Total 


Experimental 


36 


6 




Contro.i 


hi 




8.5* 


Total 


83 


10 


12.0* 



Seufople loss is alv/ays difficult to account for in an experimental 
situation.' Some students may have been sick or otherwise out of the class- 
room during the pre- or posttesting time. The logistical set-up for the test 
of this module required that an administrator be present at each testing 
session • Provisions for follow-up testing of students who missed a session 
were not feasible given the available manpower in the field* Some students 
may siuiply have avoided taking the tests. The sample loss in this instance 
is relatively small* The results of the experimental design would acem to 
be valid and therefore efforts will not be made to study the loss in detail. 
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IT. B. Types of Classes or Groupings 

Knowledge of the type of class or group setting in which the module has 
been tried is iraportant information in regard to iiiterpreting the module 
results. For the ^ modules tested in the Spring of 197^ a modified laboratory 
setting was utilized. Either a cl€issroom or a space within a library was set 
HCidr for Use by students participating in the module # When necessary, special 
equipment (e.g., video tape machines, sound on slide projectors, etc.,) '^as 
provided and if possible, stored in the space designated for the projects It 
was felt that this specialized area would tend to: 

- reduce the number of competing or distracting factors for the simulating 
group; 

- be representative of one way in which a school could implement the OEP 
program; 

- reduce the necessity to move equipment around from period to period; on^ 

- provide a place for students to store materials from one simulation day to 
the next. 



All experimental groups were conducted in this specialized or quasi experi- 
mental type of setting. Testing was also generally carried on within this 
setting. 
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II • C • Experimental Design as Implemented * 

There were two constrcdnts surrounding the implementation of the 
design as specified in the proposal for this module. Given the rela- 
tively small sample size a decision was made not to include sex as a 
variable. This eliminates the possibility of studying the test scores 
0** males and females, but inclusion of this viiriable would so reduce 
the cell size as to make meaningful interpretations difficult at besto 
The second constraint concerns the way in which the field test design 
was implemented. Four schools were tested, two classrooms or groups 
per school. Within each school one classroom was assigned to the 
experimental treatment and the other to the control treatment. It is 
apparent that no estimates of between class variability can be coraojuted 
and that any unique classroom effects are confounded with treatment 
effects. However, the test of treatments and associated interactions is 
assumed to valid,* The design is depicted schematically in Figure 1 
below: 



*This statement is based on the presumoption that there were no unique 
classroom effects, one that is supported in earlier field trials. The 
reader should note that this desigit was implemented only after consideration 
was given to the practical aspects of implementing the design. It was the 
most feasible one given the field situation. 
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Figure 1 - Schematic of the Experimental Design 
for the Health & Welfare Module* 



Pretest 



Posttest 



Alameda 
Cconty) 



Wheat Ridge 
(Jefferson 
County) 



Experimental 


Si* 


Si 

1 




1 


t 




t 


1 




Sn 


Sn 


Control 


Si 
f 


Si 




t 


t 




t 


1 




Sn 


Sn' 


Experimental 






Control 







Experimental 



Hamilton 
(Denver) 



Lake 
(Denver) 



Control 



Experimental 



Control 




♦ In order for a student's scores to be included in the analysis, he would 
have had to participate in both the pre and posttest* 
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The analysis will be the same as designated in the project 
proposal for the Occupational Exploration Program (PY'7U) with the 
exception that the sex variable has been deleted and two schools were 
added. Of key interest will be the interaction between the experimental.- 
control variable (b) and the pre- and posttest variable (C). If the 
module has had an impact upon students, a significant interaction would 

expected witn the source of the interaction being a sizeable 
experimental group gain on the posttest. Separate analyses will be run 
for the toted cognitive test scores as well as for one dimension of the 
attitudinal scale. The analyses will be in accordance with the 
abbreviated summary table shown below. 
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Table 1 - Partial Anova Summary T&ble 
For the Advertising htodule 



Source* 



df 



Potential F Test 



Between Students 



Tpwn No. 



1 k 

2 B 

3 AB 

k d/ab 

Within Students 

5 C 

6 AC 

7 BC* 

8 ABC 

9 cd/ab 



ahn-l 



a-1 
b-1 

(a-l)(b-l) 
ab(n<9l) 

abn(c-l) 

(a-l)(c-l) 
(b.l)(c.l) 
(a-lXb-l) 
ab(c-l)(n-l) 



l/h 
2/h 
3A 



5/9 
6/9 
7/9 
8/9 



TOTAL 



abcn-*l 



* A brief discussion of the variables will be included in the text immediately 
following this table. 

Bie independent variables for this module are described below: 



Variable 



Description 

Schools (Alamedaj> Wheat 
Ridge, Hamilton and Lake) 

Treatment (experimental 
vs. control) 

Testing (pr'^. vs. post) 
Students 



Type 

Fixed; between S*s 
Fixed; between S*s 



Fixed; within 

S*s (repeated measure) 

Random; nested within 
AB cosibinations 
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II. D. Instrumentation - Instrument Specifics 

1) Kaovledge Test - What Do You Know ? (The test is appended to this 

report) 

The knowledge test for heslth and welfare consisted of 3^ multiple 
choice questions. The test items emphasized two basic dimensions - process 
and responsibility. A process item generally deedt with understanding the 
nature of the steps involved in the operation of drug treatment center and 
tne necessary information to perform a certain function. An example of a 
process question is: 

Test Question ^ik 

What is the first step in helping someone who comes to a drug treatment 
center and who does not require immediate medical attention? 
*a. Interview the person ^ 

b. Identify job possibilities for the person 

c. Provide legal assistance fdr the person 

d. Arrange financial help for the person 

♦Indicates correct response 
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Responsibility questions dealt with identifying who or what group of 
people has responsibility for getting a certain job done, or who has 
responsibility for making decisions at a certain point in time, etc. An 
example of a responsibility item is: 

Test Question ^30 

The Spaceship "Enterprise" has returned from a twelve-year voyage into 
space. On one of its stops, the crew became addicted to a new drug 
contained in a sweet and good-tasting ftruit. They have been referred 
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to your drug treatment center. Who at the center will most likely 
study the new drug and the effects of the addiction? 

a. The nurse 

b. The physician 

*c« The pharmacologist 
d. The medical technician 

^^Indicates correct response 



The following table shows the breakdown of the test items by test 
content and by the process and responsibility dimensions. The content 
has been subdivided into two areas: general considerations and specific 
occupations. The test was designed to cover most of major aspects of 
content present in the module. 

Table 2 
Analysis of Test Content 
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Content Area 



General Considerations 
Center Operation 
Patient 

Specific Occupation 
Center Director 
Probation Officer 
Social Worker 
Pharmacologist 
Medical Technician 
Nurse 
Physician 
Psychologist 



TOTAL 



Process 



9 
2 



1 

1 

1 V w 



17 



Responsibility 



k 
2 

3 
2 
1 
1 



17 



Total 



9 
2 

5 
2 
2 

2 

Li 



**Some items measured content-related to two occupational areas, i.e., 
determining a common function or responsibility between two occupations. 
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2) Affective Tes t - W hat Do You Like ? (The test is appended to this 

report) • 

The affective t*2st was designed to measure student attitudinal 
change. The first six questions asked the student if he/she would like 
to try doing an activity* The student could respond in one of four ways to 
the item: 

1) Yes, I vould like to try this 

2) Jfo, I would not like to try this 

3) IVn uncertain about trying this 

k) I don't have enough information to know if I would like to try this» 
The scale is scored so that the stronger the preference for trying to 
do an activity, the higher the score. Thus, yes and no responses receive 
the same scale value of 3^ uncertain responses receive a 2, and not enough 
information types of responses receive a value of 1» These values are then 
summed and used in the analysis of variance described earlier* Summed 
scores can vary from zero (no response whatsoever) to l8. Note the scale 
is scored so that strength of preference, rather than direction of preference 
is the important factor (i»e., yes and no responses, while being in opposite 
directions, represent the same strength of preference and therefore receive 
the same score)* 

In addition to the scaled responses, students were encouraged to state 
reasons for their preferences. These reasons were classified and, in 
conjunction with the scaled responses, were coded and transferred to machine 
scorable forms* Inter-rater and intra^^rater agreement checks were made on 
the scoring process (See results section)* The last question of the 'ffhat 
Do You Like?" test section asked the student to imagine himself/herself as 
a health and welfare worker and to give advice to another person by 
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indicating what kind of experiences or activities might help him/her 
prepare for a job in the health and welfare field. (This question was 
used on a preliminary trial basis. The open-ended responses were 
classified a^id coded, but will not be reported in this document.) 

3) Student Post Module Questionnaire - What Do You Think ? (The Question- 
naire is appended to this report). 

This questionnaire was administered to students in the experimental 
group after their completion of the module and its posttest. The 
questionnaire was designed to measure student perceptions of the module. 

The first twenty questions on this questionnaire were forced choice 
in nature — the student could either agree or disagree with the statement 
posed in the stem. The twenty questions covered the following k areas: 

- perceptions of specific module parts (questions 1-7); 

- general understanding and ability to follow directions (questions 
8-13); 

- implementation or pacing of the module (questions lU-l6); and 

- perceptions about learning (questions 17-20), 

Besides the first twenty questions there were twelve additional 
questions. Three of these were "check" questions designed to provide some 
probable indication of scale reliability. The rest of the questions were 
open-ended and asked the student to supply short answers or recommendations 
for improving the simulation. Examples of areas covered by these questions 
include: role(s) played; things liked most about the simulation; things 
liked least about the simulation; new interests discovered through the 
simulation, etc. These questions will be summarized and included on the 
Reviser's Information Summary (RIS). 
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Teacher Questionnedres (The Questionnaires are appended to this report) • 
Basically, tvc Questionnaires were used for testing this module* 
The first, the Midway Questionnaire , was completed by teachers approxi- 
mately half-way through the module* This questionnaire was filled out 
,1ust prior to a mid-mod^ae panel review of the first half of the module* 
The questionnaire is designed to cover the initial elem^^nts of the Simula^ 
tion, i*e#, the Introduction to Simulation materials, the Preview, the 
l^cparation Phase, the first initial tasks, end the teacher's overall 
perceptions up to the midway point* The questions dealt with concerns 
about technical quality, fit or integration with other sections of the 
nodule, appropriate!:>ess of recommended time allotments, problems encountered, 
recommendations for change, etc. The questions were primarily on a five 
point scale with space for open-ended comments frequently provided ♦ 

At the end of the module and prior to the post MWv^ule panel review> 
teachers completed the General Module Evaluation * This questionnaire 
was similar to the Midway Questionnaire, except that its content pertained 
to the last tasks and summary phase of the modulo and to the teacher's 
perceptions across the entire module. It also contained questions dealing 
with student and teacher background. Generally, it was administered at the 
post module panel review session. The quei^tionnaire would require about 
25-30 minutes to complete. 

In conjunction with the two questionnaires Just described, two optional 
forms were provided to teachers. These were the Media Checklist and the 
Daily Inventory of Perceptions (DIP). The Checklist was simply a form that 
teachers could use if they so desired to record their feelings about media 
used in the simulation. The DIP was an open-ended diary form available 
for those teachers who were willing (or wanted ) to keep daily notes about the 
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simulation* 

Data from the two questionnaires and the optional forms, if completed, 
will be summarized and reported in the Reviser's Information Summary • 

5) Teacher Module Panel Review 

As suggested above, teachers who participated in the pilot test and 
taught the module were convened for a mid-module and post-module panel 
review. For each section of the module, the reviewers were asked to denote 
the strengths and weaknesses, the classroom solutions applied to overcome 
weaknesses, and recommendations for revision. The main reasons for the 
two panels were as follows: 

- the panels were a means of obtaining fresher or more recent 
teacher observations; 

- two shorter panels rather than a longer, more tedious panel would 
tend to reduce teacher fatigue; 

- the panels decreased the need for longer questionnaires. 

As in the case of the first three modules tested in the Fall of 1973, 
panel reviews were conducted in accordance with the panel review guidelines 
generated for the nationwide CCEM project. A member of the panel kept 
detailed notes and after the panel prepared written panel review reports. 
These are included in this document and will be summarized on the RIS. 

6) Observer Forms (The form is appended to this report) 

For this pilot test, observers were utilized to collect additional 
information about module implementation* Observer data was collected for 
all schools with the exception of Lake Junior High School. The observers 
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were women and had or were in the process of receiving the bachelor's 
degree^ Two of the observers also had extensive teaching experience* 
The forms the observers used were a mixture of checklist and open-ended 
formats • Three basic areas were covered: media; general comments; and 
interaction and activities • The observations made were reviewed and 
collated and are summarized on the E1S^ 
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III. RESULTS 



C. ?• Student Questionnaire - Collated Open-Ended Responses 
to Questions ftrom "What Do You Think?" 



Question ^23 

Name some of the things you liked most 
(The most frequent responses are liste< 

Liked Most 

Working with microscope and 

lab equipment 
Experimenting 
Diagnosing medical cases 
Working with people 
fielping i)eople 
Interviewing for jobs 
Iiearning about Jobs that were 

interesting 
Being able to simulate and 

talk at a city council 

meeting. 
Reading and working on the 

case studies 
It was fun; liked playing roles 
It wasn't much work, or too 

complicated. 



and liked least about the roles. 
I.) 

Liked Least 

Filling out forms, too much paperwork 
Reading the manuals 

Having the tests at the beginning and end* 
It was too short, couldn^t finish work. 
Too little to do at times 



Question ^8 

Name some of the materials you 
order of preference.) 

Liked Most 

Booklets 

Tape of case studies 

Filmstrips 

Video tape 

Slides for microscope 
Drugs, pills, acid 
Resource materials 



most and liked least. (listed in 



Liked Least 

Filmstrips 

Booklets 

Tests and forma 
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Question ^31 

Name some of the things you liked most and liked least cCbout the simulation. 



Liked Most 



Liked Least 



T liked it all 

Solving problems of others, 

looking at and working out 

solutions for the cases* 
Learning about different 

occupations, i.e., psycho- 

lopist . 
forking with others 
Doing the things you would 

like to be 
^.•earning how a center works 



Reading the booklets 
Pilmstrips 
Too short 
Filling out forms 

Not enough information on center and 
cases. 

Not having axxvthing to do 
Tests 

Working alone 

Staff meetings unorganized 



Question j^32 

Student recommendations to improve the simulation: 

- Extend the time length of the simulation's Tasks 3 and h. There could be a 
second city council meeting in Task h. More time should have been given for 
students to work on case studies in Task 3. 

- Create additional case studies, letters. 

- Provide more information about the individual cases in the simulation. Include 
mr^ information about his/her family and biographic data. 

- Provide nore information about the center's operation, location, zoning 
regulations, layout, size, percentage of successful cases, and facilities 
available. 

Sach role should have been clarified more and not left up to the director. 
(Each role should have been given definite boundaries as well as definite 
overlaps . ) 

- The use of the equipment (microscope) should have been explained. 
• Make the booklets easier to understand. 

- Improve the quality of the filmstrip. 

- Have guest speakers from each role visit the class. 

- Reduce the number of forms or tests to complete. 
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III. RESULTS* 



E* II - Mid Module Panel Review 



Title of Module : Health & Welfare 

Jefferson County and Denver County, Colorado 
Panel Leader ; John Radloff 

Petnelists ; Mary Ellen Speakhals, Wheat Ridge Jr.j Bud Moran, Lake Jr.; 

Judith Jamison, Hamilton Jr.; (Missing - Paul Greenfield, 
Alameda Jr.) 

Observer Participants ; Sandra Pritz, C.V.T.E. 

Date(s) Panel Met ; k/23/7h 

Number of Hours; 2 



♦interpretation has not been provided. 
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III. RESULTS 



K. II - Post Module Panel Review 



Title of Module ; Health & Welfare. - "Drug Trv>atmen'C Center" 
L.Emh. i Jefferson County and Denver County, Colorado 
Panel Leader ; John Radloff 

Panelists ; Judith Jamison, Hamilton Jr*; Bud Moran, Lake Jr. 
Mary Ellen Speckha)s, Wheat Bidge Jr. 

Observer Participants ; None 

Date(s) Panel Met ; 5/9M 

Number of Hours ; l| 



♦Interpretation has not been provided # 
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IV* Reviser^ s~~Informat ion Summary (RIS) 
A. Description of the Summary 

The Reviser's Information Summary was developed for the purpose of 
assisting revisers to assimilate information collected during the pilot 
test of a module • To accomplish this, information from each source 
avallf-ble was first reviewed and then only major thrusts or ideas from 
the source were summarized • (These key thrusts or ideas were determined 
by the Judgment of the authors of this evaluation reports) The summary 
was then transferred to the appropriate location on the large sheets 
which constitute the RIS. Lastly, each column was studied and trends 
were drawn and so recorded at the bottom of the sheet • In ascertaining 
the trends the authors used their familiarity with data, the module, and 
the data collected • 

In general there will be one Reviser's Information Summary sheet per 
part of the module and one-two sheets covering the overall nature of the 
module* On sheets which pertain to module parts, only some of the data 
sources provided information pertinent to that part* Hence, the sheets 
do have some blanks or missing data cells* The reviser should exercise 
extreme care in interpreting the information on the sheets and should 
always keep in mind that comments on the sheets represent only a summary 
of key points. In addition, it sometimes was most difficult to determine 
a trend in the information obtained* 

B* Use of the RIS 
One way the reviser might use the RIS is as fo' Lows j 

1* Read the module ~ become thoroughly familiar with it; 
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2. Read the first part of this report (Section I and II) thoroughly. 
Skim the results compiled in tables (Section III, parts A,B,C,D, 
and E.) Read section B-2 and E-S, the teacher panel review 
reports, closely; 

3. Read and study the Reviser^s Information Summary. (Consult 
original data sources, if necessary.); and 

Generate a set of revision specifications based upon knowledge 
of the module, the Reviser's Information Summary, project 
developmental criteria and other information, if appropriate. 
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REVISER'S INFORMATION 
SUMMARY 
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DATA 

SOURCE 


STRENGTHS 


Health & Welfare : Overc 
WEAKNESSES 






The experimental students increased theii 
score of responsibility questions 3«2 poi 
mean process items score hy 1.0 point. 


STUDENT 
TESTS 


The experimental group participants gained 
an average of k.2 points from pre- to post- 
testing on the 3^ item knowledge test. 
This indicates that the module was effective 
in providing occupational information. 


STUDENT 
QUESTION- 
NAIRES 


There were strong positive responses to the 
following questions as indicated hy the 
given percentages: 

Yes 

Directions were clear 71.9^ 

Tests were not difficult 75.0^ 

Booklets were easy to read 90.6^ 

Learned quite a "bit atout 

jots in this field 90.6^ 

Enjoyed working with other 

students 96.9^ 

Learned at least an average 
amount atout jobs in this 
field of work . 8U.U^ 

Discovered new interests by 
participation in simula- 
tion 76.7^ 

More interested now in 

health and welfare jots 68.8^ 

The tasks were not too 

hard for me to do 8l.3^ 

The simulation preview, 
activities, and summary 
fit well together 8l*3% 

Some of the things students indicated 
liking most about the role(s) were: work- 
ing with lab equipment, experimenting, 
helping people, "being atle to work with 
others, and applying and interviewing 
for jots^ 


There were mixed responses to the follow: 
hy the given percentages : 

Teachers explained a lot of the word: 
Teachers explained a lot of the ideal 
The simulation was too short 
Sometimes I had nothing to do 

Some of the things students indicated li: 
were: filling out forms, reading the ma 
a time period to complete tasks or havini 
times . 


REVIEW 
PANELS 


The reviewers felt that generally pupil 
confidence and self -direct ion "built as they 
progi*es8ed through the module. The students 
were so atscrhed "by the simulation's 
activities the teachers noted they verbal- 
ized many hits of personal information. 


Two teachers indicated that student absei 
significantly from the success of the si^ 
pharmacologist and the social worker shoi 
teachers noted periods of "sterility" in 
for other activities. They also felt sti 
to when to call additional staff meetingi 


OBSERVER 
FORMS 

ERLC 


Students interested in module activities. 

1 

• 


The module's success depends upon the le 
director. 
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PECOI-MENDATIONS FOR REVISION 


mean pre-posttest gain 
ntS) but increased the 





ng questions indicated 

Yes Nb 

71.% 28.1^ 
62.5^ 37.5^ 
53.1^ 

ing least about the roles 
lualS) having too short 
5 too little to do at 


Student recommendations to improve the simulation: 

• Extend the time length of the simulation's Tasks 3 and k. There 
could be a second city council meeting in Task h. More time 
should have been given for students to work on case studies in 
in Task 3* 

- Create additional case studies, letters. 

- Provide more information about the individual cases in the 
simulation. Include more information about his/her family and 
biographic data. 

- Provide more information about the center's operation, location, 
zoning regulations, layout, size, percentage of successful cases, 
and facilities available. 

- Each role should have been clarified more and not left up to 
the director. (Each role should have been given definite 
boundaries as well as definite overlaps.) 

- The use of the equipment (microscope) should have been explained. 

- Make the booklets easier to understand. 

- Improve the quality of the filmstrip. 

- Have guest speakers from each role visit the class. 

- Reduce the number of forms or tests to complete. ^ 


iteesism detracts 
lulation* The roles of the 
lid be expanded. The 
the module and the need 
idents could be "cued" as 
\ within the simulation. 


Increase involvement of roles. 

Add options for obtaining resources, speakers, field trips to drug 
clinics. 

Develop criteria for holding staff meetings. Include more staff 
meetings. 


adership abilities of the 
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Health & Welfare : Oven 


SOORCB 


STRENGTHS 


WEAKNESSES 


TEACHER 

QUESTION- 

KAIRES 


The teachers rated the overall quality of 
the nodule as good. They felt (n = h) the 
students learned much about the process of 
simolation and at least an average amount 
about health and welfare occupations. All 
but one teacher felt the module reinforced 
and helped to build the student *s ability 
to make decisions. They felt the students 
were receptive to both the simulation and 
its content. All teachers indicated they 
would like to use the simulation again with 
minor modifications and would recommend its 
use to other teachers. Two teachers felt 
the simulation improved the working rela- 
tionship between teacher and student. They 
felt the main ideas were presented with 
logical consistency. Most of the time (n 
3)9 and some of the time (n ^ 1), the mate** 
rials stimulated the interest of the stu- 
dents. Most of the time (n - 3) and some 
of the time (n = 2) students were able to 
understand the concepts. Generally, the 
directions were clear for students to under- 
stand. Three teachers felt that generally 
the vocabulary was consistent with student 
maturation level while one felt that not 
much was. There was also a discrepancy in 
noting a change in student interest or moti- 
vation: increased (n = l), decreased (n = 
1), constant (n - 1), and somewhat changed 
(n « 1). Two teachers felt the %est mate- 
rials'* of the module was Task 3 and one 
indicated Task h. 


All teachers felt there were students th) 
working in small self -directed groups as 
identified these students: l) chronic a] 
and 3) students rejected by others. The; 
teers would be most appropriate. When aj 
materials" in the module, each of the foi 
one teacher: the video tape "Interviewii 
the job application form, and the job ap' 
ers felt the reading level of the materii 
problems'*. In one class, three students 
reading level. 


TRI1ID3 


In general, the module was well received 
by both students and teachers as indicated 
by: 

1. Student gains in cognitive Isnowledge. 
2« Teacher observations that students 

gained in both confidence and self*- 

direction as students progressed 

through the module. 
3. The ability t)f students and teachers 

to follow the directions in the 

siaulation and the sequence of tasks 
k. The strong positive trends that 

emerged fjrom the questionnaires (See 

column above). 

i 7 64 


The following major deficiencies are not< 

1. There is need for greater informatio] 
roles and provides more details abou 

2. In general, the simulation was too s! 
student comments. 

3* In some roles, the students generall; 
on>osed to too much. 

U. Test results tend to indicate that m 
the occupational responsibility of n 
simulation as opposed to the process 
center. This may or may not be a we 
objectives set for the revised simul 
however, teachers seemed to be sugge 
placed on the process dimension. 

5» Generally, the readability of the ma' 
for the students at this age level; \ 
that the teachers had to explain **a 
lot of the ideas** which were present 
Table C-3 for a more detailed explan 

6. Teachers and observers noted that th 
depended upon the leadership ability 
felt there were some students that wo 
in small self-*directed groups. 
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RECOMMENDATIONS FOR REVISION 



Lt would have difficulty 
in this simulation. They 
isentees, 2) poor readers , 
indicated student volun- 
iked to describe the "worst 
lowing were mentioned by 
ig", the audio -film strips, 
Itude form. Three teach- 
es presented "some 
had "more trouble" with the 



\a in tne moaujie: 

I which clarifies the 

; the dxKVS treatment center. 

jort as evidenced by 

r had too little to do as 

>re emphaais was placed on 
)les presented in the 
of operation of the 
ikness, depending upon the 
ition. In the review panel, 
sting that more emphasis be 

:erials seemed well suited 
lowever, students stated 
.ot of words" and "a 
!d in the simulation (See 
Ition.) 
strength of the module 

of the director. Teachers 
old h^e difficulty working 



Teacher recommendations include: 

Develop additional optional assignments for those completing the 
module's tasks. 

Strengthen or provide more options for Task k. 

Possibly include the role(s) of assistant director and legal 
representative . 

Build in the role of "mock" citizens. 
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1. The module needs to delineate specific responsibilities of 
each role instead of letting the director decide. This 
would reduce sxrUdent contusion over who is responsible for 
given activities, including specific role descriptions. 

2. Study the length of time it should take students to coatplete 
each specific activity and determine whether to add/or elimi- 
nate activities for each role, making certain each role is 
meaningfully integrated with at least one "paper case". 

3* Careful consideration should be given to the process of select^ 
ing the director since the module's success is dependent upon 
his leadership abilities. 

h. Several suggestions to improve the students' cofliprehension of 
the materials: 

- To incj^>2de a student glossary containing new vocabulary; 

- To improve conceptual understanding, add more explanations 
within booklets » 

- To provide teachers with more ideas and suggestions for 
working with students. 

3. Anorther suggestion for improving tha nodule is: 

Given teacher comments about student interest in the mate* 
rials, the revi8er(s) should pay special attention to the 
intended target audience (s) for these materials « 
6. Other suggestions for revisions are found on the R«Tisar*s 
Summaig Sheets pertaining to specific parts of ths Mdole^ 



DJffA 

SOURCE 


STRENGTHS 


Health & Welfare: Introduc 
WEAKNESSE 


STUDENT 

QUESTION- 

RAIBES 


Seventy-five percent of the students felt 
that the introduction helped to prepare 
them for the simulation* 


Some students felt the filmstrips should 
slides but a live type of film. 


TEACHER 
QUESTION- 
NAIRES 


The teachers felt the booklets were better , 
prepared than the slide-tape, "Introduction 
To Simulation" • 


- 


TEACHER 
PANEI£ 


The teachers felt the content of the 
introduction to simulation tape was good, 
but the students preferred the booklets 
to the slide-tape since they felt they were 
superior* 


Two teachers felt the introduction itsell 
students did not like the drawings in th< 


OBSERVER 
FORM 










TRENDS 


From the incremental testing of materials 
in Columbus, Ohio* and the pilot-testing in 
Colorado (of several modules), it was found 
that generally the students did understand 
the concepts and vocabulary presented in 
the introduction* 

Generally, both teachers and students in 
Colorado rated the overall quality of the 
booklets superior to that of the slide-tape 
presentation. A slightly different view- 
point was observed in the incremental 
testing in Columbus in which the joint use 
of slides and booklets seemed to be 
emphasized. 


The teachers* comments from this pilot-ti 
of the introduction and the students* di 
in the slide-tapes were consistent with < 
uses of the materials (See. footnote on b< 

Other data sources* have revealed that: 
seem to be as motivating as a first acti^ 
- the materials did not emphasize or 


^Increinenl 


5al testing, Columbus, Ohio and/or data collected from the testing of other modules. 
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;ion to Simulation 



aot have been cartoon- 
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RECOMMENDATIONS FOR REVISION 



was too short* The 
slide-stapes • 



st concerning the shortness 
Jlike for the illustrations 
ata collected ftrom other 
attorn of page*)* 

the introduction did not 

rity should be; 

repeat key ideas enough* 



From other data sources*, it is suggested that: 
The key ideas be repeated more than once; 

The aiotivational level can be increased by making the simulation 
more an active than a passive ejqperience; 

The drawings and illustrations be improved (although specific 
slide-frames have not been identified) • 

Evaluation note: In working on the introduction, the reviser 
also took into account the integration of the introduction with 
the rest of the module. 
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DATA 

SOURCE 


STRENGTHS 


Health & Welfare 
\4EAKNESSE£ 


sTUDEirr 

QUESTION- 
NAIRES 


Seventy-five percent of the students felt 
that the preview helped to prepare them 
tor thr simulation* 


Some students felt the filmstrips should 
slides, but a live type of film. 


TEACHER 
QUESTION- 
NAIRES 


The previev did motivate the students, but 
to varying degrees in each class* Two 
classes were very interested in the module 
and the different occupations it introduced 
to them* 


Two classes felt insufficient informatioi 
center itself (i*e«, floor plan, faciliti 
felt the wording of the slides as "cartoi 


TEACHER 
PAIEIS 












OBSERVER 
FORM 


Students were interested in simulation 
after viewing the slide-tape presentation v 
One student asked if a visit to the drug 
treatoent center would culainate the unlt« 


Two teachers presented both parts of the 
ment center in the same class period whi! 
them on consecutive days* 

Evaluator^s comment: the teacher *s guidi 
between the two parts of the preview to ' 
slide tape* The slide snows are in sepaj 
but the two are recorded consecutively o 


TRENDS 


The Preview wea moderately successful in 
motivating students to participate ^ti the 
simulation as indicated by teacher Uii 
student commenis* 


Clear directions on how to present the m 
the teacher* 

Teachers also pointed out that the Previ 
present enough information about the dru 
jobs introduced in the simulation* 
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1. 



: Preview 
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RECOMMENDATIONS FOR REVISION 



not have been cartoon- 



was presented on the drug 
es available)* One class 
ns" was juvenile. 



The film strip should use photographs or caricatures as opposed 
to representative drawings* 

The Preview should demonstrate a classroom simulation showing 
layout and equipment of drug centers (include floor plan). 

Add more detailed information concerning the simulation's job 
descriptions* 



Preview to the drug treat- 
.e two teachers presented 



J does not distinguish 
he drug treatment center 
ate carousel slide trays, 
a the same tape. 



iterials are not given to 



tw apparently did not 
5 center itself or about 



Evaluator's comment: 

Revise the instructions to the teacher for the Preview of 
materials * 

More information could be added concerning the center and descrip- 
tions of jobs introduced in the module* 

Consider the use of photographs instead of illustrations in the 
filmstrip, e*g*, photographs showing people performing job 
functions* 
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DATA 

SOURCE 


STRENGTHS 


Health & Welfare: 
WEAKNESSES 


STUDERT 

QUESTION- 

KAIRES 


- 


The role descriptions gave little informi 
a role. Yes - hO.Of, No • kS.Ji 


TEACHER 
QUESTION- 
NAIRES 


Generally the technical quality of the 
illustrations of the booklets was considered 
' to be high. The teachers feit that the 
preparation section fit well (flowed) with 
the module's preview. The information 
provided for student role selection was 
adequate; however^ three teachers indicated 
students had some difficulty with role 
selection. 


The overlay was inaccurate for the job ai 
haa difficulty with student role selecti< 
group wanted to be the director. 


TEACHER 
PANEIS 


The teachers felt the booklets and the job 
aptitude and preference forms were very 
good as a means of helping students select 
and get into roles. 


The overlay to the job aptitude form did 
class; students did not catch on well to 


OBSERVER 
. FORMS 


Students had fun with the hypothetical 
aspects of applying for a job. The students 
enjoyed filling out job applications. 


Two teachers commented that the job apti 
to use. Two classes had to redo their ji 
overlay did not correspond correctly to ' 


TRENDS 


1. From both the perspective of teachers 
and observers, the booklets and job 
preference forms seemed to be a good 
mechanism for getting students into 
roles. The observers even commented 
on the fun students had in filling out 
applications. 

2. Teachers considered the preparation 
section to be well-integrated into the 
module* 

3# The technicaJ. quality of illustrations 
in the booklets was rated high. 


1. The overlays for the job preference : 
match the preference form. (Althoug 
the evaluators were unable to locate 
closely look at the problem.) 

2. Three teachers indicated some studen' 
selection and student responses reve 
divided in opinion concerning the ami 
in the role descriptions. 
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Preparation 


59 

RECOMMENDATIONS FOR REVISION 




tion helpful in choosing 




ititude test* One class 
since no one in the 




not properly match in one 
the form* 


Number overlav or make certain it is the same size as the -1ob 
preference form* 


;ude overlay was difficult 
)b preferences since the 
;heir answer sheet* 


Redo the profile sheets making certain the overlay corresponds 
correctly to the job preferences. 




'orms did not propei'ly 
1 it should be noted that 
an overlaj' to more 


The teachers and observers both suggested that the overlays 
be redone* 




;s had difficulty with role 
lied that the students were 
)unt of information provided 
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DATA 

SOURCE 



STRENGTHS 



Health & Welfare 



WEAKNESSES 



STUDEKT 
QUESTION- 
NAIRES 



TEACHER AH teachers felt that Task 1 had flowed 
QUESTION- well from the Preparation section The 
NAIRES teachers indicated that the st.Jients had a 
high understanding of the task directions 
and materials. Three teachers s';-ated the 
recomnended time for the task was adequate, 
while one teacher felt more time was needed. 
The teachers disagreed to the extent the 
materials were appropriate to the maturation 
level of the students; hut all felt the 
materials were at least somewhat appropriate 



TEACHER The teachers felt the role playing wa^ very 
FAHEIS interesting* The iuterview worked well when 
the director prepared questions in advance 
ftom the students* applications. 



Two teachers felt the joh application waa 
too difficult. One teacher felt the inte 
her class; however, the observer of her c 



In the video tape "Interviewing", the poc 
The job application forms are too long ai 

The students were hogged down by the sal? 
perience sections. 

Students should be warned that the applic 
the interviews. 



OBSERVER In two classes^ the directors did an excel- 
FORMS lent Job of interviewing for staff positions 



At one school, the teacher took over the 
viewed the students. 

There was difficulty obtaining the video 

One teacher indicated the job applicatioi 
fill in. 

At one school, students did not read the 
ing. The observers noted that some stud< 
others were being interviewed by the dir< 



TRENDS 



1. Task 1 was well integrated into the 
simulation. In two classes, the direc- 
tors did an excellent job, resulting in 
the task being iinplemented as specified « 

2. Generally, the time seemed to be ade- 
quate and all of the materials were at 
least somewhat appropriate to the 
maturational level of the students. 
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1. Several teachers felt that the form i 
for the students to complete. They 
much time with the salary and previoi 
of the application. 

2. Students should have advance knowledi 
that they are completing will be usei 
positions in the drug treatment cent 

3* Several key factors emerged with reg 

- the poor candidate was too obvious 

- the videotape equipment may be dif 
schools; and 

- students had nothing to do and som 
were interviewing. 
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: Task 1 


60 

RECOMMENDATIONS FOR REVISION 







either too complex or 
rview didn't work well in 
lass felt it did. 




r candidate was too o'bvious* 
d detailed* 

ry and previous work ex- 
ations will "be used during 


Video tape "Interviewing" could he omitted. 
Eliminate some items in jdh application. 
Add role playing practice activities. 

Students should he warned that job applications will he used 
during interviews. 


director's role and inter- 
tape machine in one school* 
I form was too involved to 

handhook before interview- 
nts "became hored while 
ictor. 




ras too long and complex 
iited students spending too 
IS work experience sections 

^e that the applications 
i during the interviews for 
jr. 

ird to interviewing: 
on the videotape; 
Ticult to ohtain in some 

» "became "bored while others 

ERIC , 


1. Eliminate some items on the job application form. 

2. Inform students in advance that applications will be used 
during interviews. 

3. After considering the comments in the weaknesses section, a 
decision needs to formulated to determine whether or not 

the videotape, "Interviewing" should still be included in the 
module. In light of possible difficulties in obtaining 
equipment, other alternatives should be examined. 

k. Add role playing practice activities. 
Evaluator's Recommendations: 

5. Since some became bored during the interviewing, the following 
alternatives ere suggested: 

- provide director with a structured interview schedule; 
• use the first several interviews as a means for other stu* 
dents to learn about interpersonal relationships between inter- 
viewer and interviewee. Have students observe and then discuss 
the strengths and weaknesses of ihe first several interviews • 

3 



DATA 

SOURCE 


1 

STRENGTHS 


Health & Welfare 
WEAKNESSES 


STUDENT 
QUESTION- 






NAIRES 






TEACHER 
QUESTION- 
NAIRES 




One teacher indicated that in her class i 
cases to the staff members. 


TEACHER 
FAHEI£ 


Generally, the tecuihers felt the task was 
"good" and operated as intended. 


One teacher commented that the director i 
author it at ively . 


OBSERVER 
FORMS 


In two classes the director W€is very capable 
and ran the staff meeting smoothly. 


The success of this task is dependent up< 
director. In one class, the director wa: 
the group activity which resulted in hav: 
group. 


TRENDS 


In general, the task seemed to work 
well. As noted "by the observer, this 
may be a function of the skill of the 
student who is in the role of the 
director of the drug treatment center. 

• 


To reiterate, the success of the act: 
a function of the center director, 
work out well in his/her role then t; 
smoothly. Also, there may be some pi 
the procedures for assigning paper ci 
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: Task 2 


61 

RECOMMENDATIONS FOR REVISION > 






hey had trouble assigning 




ole was played too 




n the abilities of the 

uncertain of how to lead 
ng the teacher direct the 




vity is to a high degree 
f the director does not 
e activity does not proceed 
oblem or difficulty with 
ises. 


Evaluator^s Reconmendation 

Few, if any* provisions were made to assist the director in 
assigning paper cases. (There are however, some suggestions in 
the teacher* s guide.) Perhaps these suggestions should be made 
available to the director. 
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IMTA 

SOURCE 


STRENGTHS 


Health & Welfare 
\ffiAKNESSES 


STUDENT 

QUESTION- 

NAIBE 




The probation officer needs more things t 
Need to add more case studies and more ir 
studies. 

The use of the microscope should have bee 
Roles should have been clarified more. 


TEACHER 
QUESTION- 
NAIRE 


Generally, the teachers felt the recommended 
time for the task was appropriate • They 
differed to the extent the maturations! 
level of the materials was appropriate for 
the students; "but all teachers felt the 
materials were at least somewhat appropri- 
ate • They indicated that the flow of tasks 
with each other was generally good. Three 
teachers felt their class had at leeust a 
"medium" understanding of the task direc- 
tions and materials* 


The teachers felt that the medical techni 
cologist's role and experiments should be 
cases and integrated with other task role 
pharmacologist's, medical technician's, a 
required longer to complete than others, 
medical doctor's, pharmacologist's, and p 
have enough activity. 


TEACHER 
PANELS 


Pupils able to get into interaction and 
consultation activities. The teachers 
felt the "extra items" in the task were 
very good. (i#e., telephone messages, 
letters.) 

• 


The teachers indicated that the Pharmacol 
technician's roles were not related to ca 
one class questioned why the probation of 
opportunities. In two classes, the stude 
operating the microscope. The teacher's 
that a microscope would be needed. In th 
role, it was unclear as to which slide (s) 
probation officer's forms and the nurse's 
difficult and complex. Not all the neces 
present for the nurse (i.e., referring ca 
Mary on the case study form is incorrect, 
pupils who did not receive a role packet 
the length of time to complete separate r 
some students completed their tasks much 
had nothing to do. 


OBSERVER 
FORMS 




The observers related the following probl 
the probation officer were too complex fo 
microscope was a problem; the nurse didn' 
with the information in the letter about 
wait for others to finish tasks before th 
the medical technician felt the slides we 


TRENDS 


1. Generally, the task was felt "by teach- 
ers to be somewhat or fully appropriate 
for the maturational level of the 
students. (Students were able to inter- 
act with each other when working on 
"cases".) 

2. Teacher felt that understanding of the 
task directions and materials was 
adequate . \ 

3# Extra items contained in the role pack- 
ets seemed to work well. Perhaps more 
should be included. 


1. At times some students had too much t 
little to do. The pacing of the indi 
seem to be well integrated. 

2. As indicated above, there are many sp 
dividual booklets and role packets, 
fully read the column. 

3* Role clarity appears to be a problem, 
roles not well defined, their relatio 
the paper cases included in the simul 
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: Task 3 


62 

nbL.UMMDi>ll/AllUWb rUn KbVXbXUK * 


D do, 

formation to existing case 




1 explained. 




cian's and the pharma- 
more relevant to the 

B. In one class, the 

id social worker's roles 
One teacher stated the 

Bychiatrist's roles did not 


Additional optional activities should he developed and provided 
for students in roles to avoid "lag time" (activities could vary 
in complexity to account for different ability and interest' 
levels). (See student results in Tahle C. k.) 


ogist's and medical 
se studies. The pupils in 
ficer was working with jot 
ats had difficulty 
nanual did not indicate 
e medical technologist's 
to use for what. The 
forms were felt to "be too 
sary information was 
se to doctor). The sex of 

General coimnents were: 
felt cheated; the range of 
ole tasks was too diverse; 
earlier than others and 


Integrate roles of pharmacologist and medical technician to 

correspond to actual cases in module. 

Provide optional activities for early finishers. 

Add additional extra items such as letters, telephone messages. 

Add instruction sheet for use of microscope and indicate in 

teacher manuals that a microscope is needed for the activity. 

Develop role "packets" for all roles to eliminate hurt feelings 

of students not receiving them. 

Include additional information needed for nurse's nedical forms. 
Improve directions for medical technician in interpreting and 
identifying slides. Use more interesting blood cell slides 
(e.g. sickle cell). 

Simplify probation officer's legal form and provide better explana-v 
tion. 


ems: the legal forms for 
r this age to fill in; the 
t understand what to do 
Judy; some students had to 
ey could start theirs; 
re poorly prepared. 




0 do, while others had very 
vidual assignments does not 

ecific problems within in- 
rhe reviser should care- 
Not only are some of the 
nship to each other and to 
ation is confusing. 


1. Provide other activities^ for those roles that presently are 
quite brief. Examples might be: 

- Students who have finished their role assignment can assist 
others with theirs; 

• More activities could be included in some of the roles; 

* Expanded exploration in an individualized instructioni&l mode 
could be used by early finishers (some of the expanded explora- 
tion activities now being considered for the OEP program might 
well be another alternative.) 

2. Clarify/alter the directions, etc. in some of the specific 
booklets and role packets as indicated above. (Special 
attention probably should be paid to the roles of probation 
officer, pharmacologist, psychologist, and medical technician.) 

3* Also include more additional "extra" items in role packets. 
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Health & Welfare: T« 



DATA 

SOURCE 


STRENGTHS 


WEAKNESSES 


STUDBRI 
QUESTION- 
NAIRE? 


The sunmary helped to pull things together , 
Yes - 75.0^. 1 


There should have been more time for Tasl 
meeting could have been called. 


TEACIER 
QUESTION- 
NAIRES 


OVo teachers felt the task was somewhat 
effective in helping students learn about 
occupational roles played by others in the 
simulation* 


In two classes, breaks in flow or integri 
between Task 3 and Generally, howeve: 
task integrated well with the immediate \ 


TEACHER 
FABEIS 


Two teachers felt this was the most 
interesting task of the module. The stu- 
dents made a spirited defense of the center. 
In one class , students wanted to continue 
in moduli activities after city council 
meeting. 


In one class, the students were unenthus 
make a presentation to others. 


OBSERVER 
FORMS 


; ■ 

The city council meeting generally went 
well. In one class, the teacher served as 
the "council". 


Students wanted to have more information 


TRENDS 


Clearly, the task was successful as indi- 
cated by the teachers* comments. In one 
class, there was insufficient time allotted 
to complete the activity given student 
motivation. 


For some classes, more time was needed t 
is some break in flow of activity betwee 
felt not enough information was presente 
zoning laws or legal considerations coul 
simulation.) 
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63 

RECOMMENDATIONS FOR REVISION ' 


: k. A second city council 




ition of tasks occurred 
the teachers felt the 
ictivity. 


Improve flow of activities between Task 3 and Task h. 

Add an attorney role to provide legal assistance. 

Add information that will satisfy student curiosity about legal 
standing of center. 

Add one preparation day if outside class is to come in as city 
council members. 

Provide a summary of simulation to outsiders coming in as city 
council members. 


.astic and didn't want to 




about the center. 




0 complete the task* There 
a Task 3 and k. Students 
d about the center, (e.g. 
a be brought into the 


1. The revisors should pay special attention to the integration 
of Tasks 3 and k. 

2. Offer the option of expanding the time ftrom one to two periods. 

3. To add more information regarding the center and possibly 
adding other roles such as that of an attorney who might 
handle legal problems at the center. 
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APPENDIX A: 



HEALTH AND VJELFARE 
Knowledge Test - "What Do You Know?" 
and 

Attitude Scale - "What Do You Like?" 
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The project presented/reported herein was performed pursuant to 
a grant from the National institute of Education, Department of 
Health, Education, and Welfare. However, the opinions expressed 
h«irein do not necessarily reflect the position or policy of the 
National Institute of Education, and no official endorsement by 
the National Institute of Education should be inferred. 

Jcpyri£;ht 197'f by the Ohio State University, The Center for 
Vocational and Technical Education. 

Copyright for these materials is claimed only daring the period 
of development, test, and evaluation, unless authorization is 
granted by the rjational Institute of Education to claim copyright 
also on the final materials. For information on the status of 
th-i copyright claim, contact either the copyright proprietor or 
the national Institute of Education. 



HEALTH AND WELFARE 



WHAT DO YOU KNOW? and WHAT DO YOU LIKE? 



This booklet contains two short tests. The purposes of the tests 
urc to find out what you know about work in the health and welfare 
field and what kinds of cictivities you might enjoy doing in health 
and welfare. These tests will not in any way affect your grade. 

D irect ions: To complete the first test, use the Answer Sheet and 
pone ir" that have been provided. In one corner look for the blanks 
marked "Course," Instructor," etc. Then write in your name, your 
class name in the blank marked "Course," your teacher's name in the 
blank marked "Instructor," and your school name in the blank marked 
"Campus." Then right above where you've been writing, darken the 
spaces which indicate your sex and today's date. 

For each question on this test there are several short phrases or 
stateiRonts listed. Pick the one that best describes your answer 
and then darken the appropriate space opposite the item number on 
*^he answer sheet. Note: on the answer sheet the item numbers go 
across the page instead of up and down^ 

Be sure, that your marks are heavy and black and that they completely 
£111 the spaces. Erase completely any answer you wish to change^ 
Do not make any stray marks on the Answer Sheet. 

If you don't know the answer to a question, GUESS . 

Thanks for your help. 



You may turn the page and start as soon as you have completed 
reading the above paragraphs. 
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HEALTH AND WELFARE 



"WHAT DO YOU KNOW?" 



FILL IN THE FOLLOWING INFORMATION 



Name Age ^Grade 



STAR'l' THE TEST 



i What person on the staff of a drug treatment center v^ould most 
likely use individual and group therapy? 

£K The probation officer 

The psychologist 
c* The social case worker 
d. The public health nurse 

2* Which two workers in a drug treatment center have the most similar 
types of training? 

a. The nurse and the pharmacist 

b* The probation officer and the social worker 
c- The psychologist and the nurse 

The center 'director and the probation officer 

The process of diagnosing what is wrong with a patient at a drug 
treatment center is similar to which of the following? 

d- Servicing a broken TV 

b. Taking an inventory of parts necessary for TV repair 
Supplying necessary instruments and parts for TV repair 

J. Evaluating TV repair work 

4. Which of the following skills is, important for a nurse or potential 
nurse to have? 

a. Record keeping skills , 

b. Personal interaction skills 

c. Public speaking skills 

d. Only a and b 

e. Only b and c 

/ 
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5. A drucj treatment center is opening in Oakville. What factor or 
r-^ctors must be considered before the center begins to operate? 

a. How to finance the center 

b. V;hat people the center should treat 

c. Whore to locate the center 

d. All of the above 
G. Only a and c 

6. What activity do the case worker and probati&n officer in a drug 
treatment cent*^:r have in common? 

.a. * Ilclpiig .people get better housing 

Working witii people in"^ trouble with the law 

c. Identifying possible jobs for people 

d. All of the abn^'e 
Only a and c 

7v Which of the following tasks would most likely be the responsibility 
of the nurse? 

a. Looking for and recording physical symptoms in patients 

b. Counseling patients with mental problems 

c. Performing laboratory experiments 

d. Diagnosing emotional problems 

S. If you are a case worker in a drug treatment center, what would 
Le one of your most important responsibilities? 

a. Treating people with mental problems 

i». Preparing surveys and questionnaires 

c. Helping people get better housing, food, and employment 

d. Giving and interpreting personality tests 

V. 'What type of personal interaction skills is most essential for 
people who work in a drug treatment cen^'er to have? 

a. The ability to listen well 

b. The ability to direct the work of others 

c. The ability to talk and question well 

d. The ability to communicate ideas in writing 

10- Paul Smith has come to a drug treatment center for halp. One y 
of his most pressing needs is tc^ind legal assistance. To 
what person might Paul's case be given? \ 

a . The center director 

b. The probation officer 

c. The psychologist 

d. The sociologist 
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LI. Mary has been treated at a center and cured of her addiction. 
Tests taken at the center have shown that she is quite intel- 
ligent is good at working with her hands but tends to be 
somewhat shy and withdrawn* Who at a drug treatment center 
most likely made the test interpretations? 

a* The center director 
b* The psychologist 

c. The public health nurse 
The social case worker 

12. Which oi tlie following staff members of a dtug treatment center 
could be compared to a "detective"? 

a. Tlie probation officer 

h. The registered nurse 

The social case worker 

d. The practi,*al nurse 

13. Karen has revealed in tae first interview with the staff of the 
drug treatment center that she is very unhappy and has no friends 
ur. .school. Who would be most likely to help her? 

a. The nurse 

The psychologist 

c. The probation officer 

d. The center director 

14 . What IS the first step in helping someone who comes to a drug 
troatmentr-^center and who does not require immediate medical 
-iLtention? 

a. Interview the person 

b. Identify job possibilities for the person 

c. Provide legal assistance for the person 

d. Arrange financial help for the person 

15. What might the director of a drug treatment center do? 

:i. Talk bfjfore groups of people 

b. Conduct staff meetings 

c. Prepare a budget 

d. Arrange consultations 
Q. All of the above 

16. A medical technician is to a medical technologist as a 

a. Probation officer is to a parole officer 

b. Pharmacist is to a pharmacologist 

c. Public health nurse is to a practical nurse 
d» Psychologist is to a counselor 
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17- 



Who has the major responsibility for organizing the work of 
others in order to help people who come to a drug treatment 
center? 



a. The psychologist 

b. The probation officer 

c. The center director 

d. The case worker 



18. Who in a drug treatment center would know most about the 
physical effects of drug abuse? 

a. The oharmacologist 

b. Tlie nurse 

c. The doctor 

d. The medical technician 



19* John decides on a voluntary basis to seek help for his drug 
problem. As director of a drug treatment center, to whom 
would you probably send him first? 



a. The nurse 

b. The medical technician 

c. The physician 

d* The social case worker 



20. In order for staff members of a drug treatment center to gain 
the trust of drug abusers # what should they do with the infor- 
mation collected about the abuser? 



a. Keep it confidential 

b. Share it with the person's feimily 

c. Send it to other agencies 

d. All of the above 

e. Only a and b 



21. What is a major duty or function of a medical technician? 

a. Giving medications to patients 

b. Recording symptoms of diseases that patients have 
c' Testing blood and other body fluids 

d. Running experiments with drugs 

22. There is a meeting of citizens concerned about the presence of 
a drug treatment center in their community. Who would likely 
represent the center at the meeting? 

a. The psychologist 

b. The probation officer 
• c . The center director 

d. Only b and c 
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23. 



in trying to help a person who comes to the center^ what is the 
first step? 



a. Interviewing the person to determine needs 

b- Examining the person and making a medical diagnosis 

c. Providing immediate legal assistance 

d. All of \:he above, depending on the situation 

24 • The pharmacologist and the medical technician have what in 
common? 

a- Thev study the effects of drugs 

They have very similar types of training 
c • They run tests on body fluids 

d. They work closely together in treating diseases 

25. When is a case history usually written about a person who comes 
to a drug treatment center? 

a. AEter the staff has decided the kinds of holp the person 
needs 

b. After the person's case has been given to a staff member 

c. After the first interview , . 

d* After the person has stopped coming to the center for help 

26- As a psychologist in a drug treatment center ^ you/ might be 
expected to perform which of the following tasks? 

ci- Help a person find a job 
L. Write a case history 

Administer aptitude tests 

d. Conduct staff meetings 

27. In general^ whose work does the doctor depend on most heavily 
to help him check his diagnosis? 

a • The nurse 

b. The psychologist 

c. The medical technician 

d. The pharmacologist 

28. If you like to do accurate as well as very detailed work, you 
probably would enjoy which of the following jobs? 

a. The social case worker 

b. The probation officer 
c* The center director 

d. The medical technician 
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29. 



Which of the following sets of information would be included 
in the case history of a drug abuser? 



30. 



31. 



32. 



33. 



34. 
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a. Medical records 

b. Work records 

c. School records 

d. Legal records 

e. All of the above 

The spaceship "Enterprise." has returned from a twelve-year 
voyage into space* On one of its stops the crew became 
addicted to a new drug contained in a sweet and good-tasting 
fruit. They have been referred to your drug treatment center- 
Who at tne center will most likely study the new drug and the 
effects of the addiction? 

a» The nurse 

b. The physician 

c. The pharmacologist 

d. The medical technician 

Vftien a person is applying for a job at a drug treatment center, 
what information is considered before the person is hired? 

a. Information provided on forms and transcripts 

b. Information provided by character references 

c. Information provided in an applicant interview 

d. All of the above 
o. Only a and c 

If the director of a drug treatment center discovers that some 
staff members have too many cases to work with while others 
have too few, what is he most likely to do? 

a. Leave the situation as it is 

b. Reassign some cases to others by himself 

Consult the psychologist about .reassigning the cacres to others 
d. Call a staff meeting to reassign cases 

What position would the director of a drug treatment center be 
most similar to? 

a. An astronomer 

b. An orchestra conductor 

c. A teacher 
d» A lawyer 

What statement best describes the interaction of a staff at a 
drug treatment center? 

a. They always work alone, but see each other's reports 

b. They seldom work together and seldom see each other's reports 
c- They work together as a team, sharing reports and ideas 

d. They work only with the director 
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HEALTH AND WELFARE 



"WHAT DO YOU LIKE?" 



riiis is the second set of questions for you to answer. The 
purpose of these questions is to find out what types of activ- 
ities you might enjoy doing in the health and welfare field. We 
would also like to know what reasons you have for liking these 

''ctl^^'lt i ^s • 

There are only seven (7) questions to answer. Directions for 
answering are found on each page. Write your answers directly 
on t:hc pacjo. 

After you have completed the questions, please return this book- 
let and your answer sheet from the first test to your teacher- 

Titdnks for your help. 



Please turn the page and begin the questions as soon as. you have 
finished reading the above paragraphs • 
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7. Below is a conversation between two people. Person 2 is 
looking for a job and is considering work in the health 
and welfare field.. Person 2, a worker in health and* welfare 
is thinking about giving person 1 some advice. Pretend 
that you are person 2, giving advice. Simply complete 
person two's advice at the end of the conversation. 

Person 1: Hi pal, how's it going? 

Person 2: Well, aside from having my car stall in the 
morning rush hour, everything's pretty good. 
Hov;'s it with you? 

Person 1: Fine, but I've been thinking about doing something 
different. I've become very concerned about the 
growing problem of drug abuse. Don't you work for 
a drug treatment center? 

iorson 2: Yes, I've been with the Oakville Drug Treatment 
Clinic for the last year. 

Person 1: Listen, would you help me out? Would you tell 
me what kind of experiences or activities might 
help me to prepare for a job in the health and 
welfare field? 

Person 2: Sure, here's what I would do if I were^u. 
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APPENDIX B: 

HEALTH AND WELFARE 
Student Questionnaire - "What Do You Think?" 
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The project presented/reported herein was performed pursuant to 
a Grant fjrom the National Institute of Education, Department of 
Health, Education, and Welfare. However, the opinions expressed 
herein do not necessarily reflect the position or policy of the 
National Institute of Education, and no official indorsement \>y 
the National Institute of Education should he inferred. 

n^oyright 197U hy the Ohio State University, The Center for 
Vocational and Technical Education. 

C'^pyright for these materials is claimed only during the period 
of development, test, and evaluation, unless authorization is 
granted hy the National Institute of Education to claim copyright 
also on the final materials. For information on the status of 
the copyright claim, contact either the copyright proprietor or 
th3 Njitional Institute of Education. 
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WHAT DO YOU THINK?" 



Now that you have completed this simulation, the people who developed 
it would like to find out what you think about your experience. Your 
ideas will help to make the simulation better* Remember, THIS IS NOT 
A TEST and your answers will not be graded* So feel free to check 
and to say what you think about this simulation. 

?o complete the questionnaire first fill in the information requested 
below. 

F ILL IN THE FOLLOWING INFORMATION 

Date 



School City_ 



Grade (circle one) 8th 9th Other (please specify) 

r,ex (circle one) Male Female 

Subject taught in this cla^^s ji^ 

Teacher's name , - 

START THE QUESTIONS. 

This is a list of statements which describe ideas about the simuU\tion 
module you have just completed. Answer each statement by checking the 
category which comes closest to what you think: 



Check " AGREE " if you think the statement is true for you. 

Check " DISAGREE " if you think the statement is NOT true 
for you. 

AGREE DISAGREE 

1. The preview and the other activities at the 
beginning help^rd to prepare me for the 

simulation . 

2. The role descriptions gave me little 

information helpful in choosing a role. 
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3. I selected a role by myself • 

4. The teacher helped the class to 
select roles* 

5. Some of the tasks were too complicated 
or too hard for me to do, 

6. The summary helped me to "pull things 
together. " 

7. The simulation preview^ activities and 
summary fit well together. 

:\icre were toe many forms to fill out wich 
this simulation. 

I'iiQ directions in the materials were clear 
to me. 

10 The teacher explained a lolE^f words. 

i«. Ihr: pretest and posttest were difficult for 
me* 

12. The booklets and resource materials were 
caijy to read. 

i:^ Tht% teacher explained a lot of ideas. 

14. The simulation was too short. 

1^- Sometimes I had nothing to do. 

IC • .Sometimes I had too many things to do in ^ 
this role. 

17 • I learned quite a bit about jobs in this 
field of work. 

18. 1 learned very little about how to work 
with other people. 

19. The simulation did not help to answer 
some of the questions I have about jobs. 

2C. I enjoyed working with other stxidents 
during the simulation. 



BEST copv hmmu 



Answer these questions by circling the letter in front of the phrase 
that best describes your answer • 



21. How much do you feel you learned about jobs in this field of work 
from the simulation? 

a. Very h. Much c. An average Little e. Very 

much amount Little 

22. liow much trouble do you feel you had knowing what to do next in 
the simulation? 

a. Very b. Much c. An average d. Little e. Very 
much amount little 

23. licw would you judge the length of time you spent participating 
in this simulation module? 

a. Too b* Long c. Just d. Short e. Too 
long right short 

For the next questions, write in your answers. Space has also been 
provided for you to write in any comments/suggestions you might have* 
You are encouraged to do so* 



24. What role (or roles) did you play in this simulation? 



Wame some of the things you liked most about the role(s) and some 
of the things you liked least about the role(s) • 

Liked Most Liked Least 



26 • What other roles in the simulation did you find interesting? 



27. Why did you find this role (or roles) interesting? If you did 
not find any other roles interesting, can you say why? 
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28- Name some of the materials (Examples: slides, tapes, films, 
resource materials, booklets, etc.) you liked most and some 
of the materials you liked least . If you did not use any 
materials^ checl^ this space. 



Liked Most Liked Least 



29. Compared to your former feelings, how do you now feel about 
jobs in this area of work? 

WHY? 

I am more interested now 

I am less interested now 



I was not interested and 

I feel the same way now 

I was interested and I 

feel the same way now 

30- Did you discover any new interests by participating in this 
simulation? 

Yes, I am now interested in 



No 



31- Name some of the things you liked most about the simulation 
and some of the things you liked least about the simulation. 

Liked Most Liked Least 
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32. Write down some of your ideas on how the simulation might be 
made better ♦ 



As soon as you have completed these questions, turn in this booklet 
to your teacher. 

Thank you. 
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APPENDIX C; 

Midway Questionnedre 
and 

General Module Evaluation 
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MIDWAY 
QUESTIONNAIRE 
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MIDWAY MODULE QUESTIONNAIRE 



The qucstionnairu- is divided into several sections. Each section' 
in orJor corresponds to a part or a phase of the simulation module. 
The last sections deal with your overall perceptions at this point 
in time r.>qardi...j what hi^s happened in the module. 

Fill :a\ the informal: I'^n requested at the top of the questions. 
'V^ )T\ ar.owct each q;»e;5tjLori by circling the letter in front of the 
[>* i * chai Lo.'i \ , ^ocs your answer, unless ^jivon other specific 
directions In tlio jv-ostion. Space has also been provided for you 
w '.'.xil^i J :* ai. 'a uv.iLs/suggestions you might have. You are en- 
coura<jed to do sc* . 



{\:; L I..* Till': FOy.LOW r info rmation 

r-^cic-iier Kame School 



^"^tc ^ Part of the Module you are now working on 



IUT->OnMCTTON TO SIMULATION 



uv-iali, how would you rate the technical quality (appearance, 
> . nsor etc) of the slides and booklet? (Answer both 

;»t*L>> of question if applicable*) 



Very Good 
.Good 
Average 
Poor 

Vorv Pr^or 



Booklet 

a. Very Good 

b . Good 

c. Average 

d . Poor 

e. Very Poor 



Comments 



ill what order \;ould you recommend the use of slides and the 

r>:H;!.lel? ('^':n^> u: only one) . 



b . 
c , 
d, 
o « 



Use both in any order 

Use O'V^h with booklet first 

Use both with slides first 

Use the booklet only 

Use the slides only 

None of the above 



3. Please record any strengths and/or weaknesses that you observed 
while v/orking with this part of the simulation module 



BEST con hmum 
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4. ln<Ucat:e the form of presentation used (e.g., booklet, sound- 
j;iidc, <jamc, etc.) 



L). How would you rate the technical quality (ease of use, appear- 
ance, -tc,^ for media and/or the illustrations for booklets? 

a. Very b. i!irih c. Medium d. Low e. Very^ 
nigh LOW 

6. In your judgment, did this form provide pertinent information 
that :i\ude) v .> ..ould use in making decisions about module parti- 
c ipation? 

<i. Very b. Rather c. Average d. Not very e. Not Perti- 

Portinont Pertinent Pertinent nent at all 

/\ overall, how would you rate the ability of the "Preview" form 
tor motivating students to participate in the module? 

a. Very b. High c. Medium ,d. Low e. Very 

ubjh Low 

8. vayt^ record any strengths and/or weaknesses that you observed 
whLio working with this part of the simulation module 



^ " -X-l:^^^"'. niASE/ROLE SELECTION 

inciicate the form of presentation (e.g., slide-tapes, booklets, 
oLc.) used in the Preparation Phase 



10. How would you rate the technical quality (e.g., ease of use, 
appearance, etc.) for media and/or illustrations for booklets? 

a. Very b. High c. Medium d. Low e. Very 
ii\qh Low 

11. liow well did the Preparation Phase fit together with the Module 
Preview? (i.e., did the Preview flow into the Preparation Phase?) 

a. Very b. Vtell c. Somewhat d. Poorly e. Very 
Weil Poorly 

12. Did tlic initial role descriptions provide students with enough 
information for selecting roles? 

a. Yes, the information was very adequate 

b. Yes, the information was rather adequate 

c. No, the information was rather inadequate 

d. No, the information was very inadequate 
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13. if schematic devices (e.g. schedule cards) wexo available to 
help select roles, did students understand how to use them? 

a. Yes, with little or no help 

b. Yes, with some help 

o. Yes, with a great deal of help 
a . No 

''i. Wot applicable 
I'*. Wore the stucU-ats able to independently select themselves into 



.i. Yes, J.,, l..:tlo difCiculty 

b. Yes, with aome difficulty . • 

No, f;-. r; teacher assistame was n-.^wc 3u.iry 
u. No, extensive teacher assistance v;as necessary 

you hari to help students select roios , please describe the 
nature of tliat assistance (e.g. asked students to draw lots when 
several wanted the same role; explained use of schematic device, 
occ.) in the space below: 



"livtr.r; -eccn-d any strengths and/or weaknesses that you observed 
w.:;lo working with this part of the simulation module 



Vl'<\:\ TASKS 



Thiii section includes questions about the implementation of tasks 
lU'i flow of one ho another, etc. We would like your reactions 

.01 he -.aski. up point. We realize that you have not completed 

cu OL ti.o tasks. We vxi.' ask you about the later tasks in the short 
questionnaire administered after the module has been completed. 

17. In general, was the recommended time appropriate for completing 
the tasks? ^ 



a . Yes 

b. r.omcwhat 

c . No 

If "No," please specify the task(s) 
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18. In general, were the tasks appropriate to the maturational 
level of the students? 

a. Yes 

b. Somewhat 

c. No 

If "No," please specify the task{s) 



19. How would you rate the flow or integration of one task with 
another? 



a • ^^^y b . Good c • Average d • Poor e . Very 



Jid you hav { ony special problemii or anv particular breaks in 
flow? 



a . Yes 

b. No 

If "Yes/' please specify 

21. now would you rate student understanding of task directions 
a»i(]/'or task materials? 

Very b. High c. Average d. Low e. Very 
High 

it "Low/' or "Very Low/' please specify 



i'Ld the students have any major problems in implementing the 
tasks? 



a. Yes 

L . Somewhat 

c • No 

If "Yes/' please specify 



23. Please record any strengths and/or weaknesses that you observed 
whilo worki-v .^Mth this part of the simulation module 



STUDIilNT INTEREST AND UNDERSTANDING 



24. In general, were the directions in the module clear enough for 

students to understand what was expected of them? 

a* Very b. Clear c. Average d* Unclear e. Very 
Clear Unclear 
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25* In general ^ was the vocabulary of the module consistent with 
the maturational level of the students in the simulation? 

a. Yes, most b. Yes, some No, not d. No> none 

of it of it much of it of it 

2^. In general/ were the students able to understand the concepts 
presented in the materials? 

a* Yes y most b. Yes, some of c. No, not much d. mo, not 
of the tiTio the time of the time at all 

27 • In gcneraJ / d icl uhe materials stimulate student interest? 

a. yos, mo';t b* Yes, soma of c. No, not much d. No, not 
of the time the time of the time at all 

28 • Did your students experience problems with the reading level 
^i! this simulation module? 

a. Yes, many b. Yes, some c. Yes, but few d. No 

problems problems problems problems 

^9* V'hi"'-3 working with the students in the simulation module, did 
yoa spend extra time in reviewing the basic concepts presented 
in that phase? 

a. Yes, I spent much time 

Yes, I spent little time 
c. lio, I didn't spend any time 

30. Please record any strengths and/or weaknesses that you observed 
while working with this part of the simulation module 



ADI::QUAC Y of materials - OVERALL PERCEPTIONS 



31. In general, how well did the transitions from phase to phase 
of the module proceed? 

a. Very b. Well c. About d. Poorly e. Very 

Well Average Poorly 

32. Up to this point, are there any additions, deletions, or 
changes in the module that you feel should be made? 

a. Yes, make the following changes 



b. No changes are necessary 
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33. Are there any parts of the module that "just didn't work?" 
a. Yes, the following parts ^ 



b. No, all parts worked well 

34. Ail factors considered, which specific set of materials would 
you rato as the besV? 



35. Ail factors considered, .vhich specific set of materials would 
you rato as tho worst? 



. Up to this point, add as many comments and/or suggestions for 
revision of the module as you might have. 
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GENERAL MODULE 
EVALUATION 



GENERAL MODULE EVALUATION 



This questionnaire is divided into several sections. The 
first two sections correspond to the last tasks in the module 
(i.e., those from the Midway Questionnaire to the end of the 
module) and to the Summary Phase. The last sections deal with 
general teacher and student background and your overall percep-- 
--iuns of the quality of the materials, implementational problems, 
student interest and understanding, etc. 

Answer each question by circling the letter in front of the 
phrase that best describes your answer, unless given other specific 
directions in the question. Space has also been provided for you 
to v;rite in any coironents/suggestions you might have. You are en- 
couraged to do. so. 
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GENERAL MODULE EVALUATION 



FILL IN THE FOLLOWING INFORMATION 

Teacher Name School ^Sex 

Years of Teaching Experience City 

LAST TASKS 

1. In general y was the recommended time appropriate for completing 
the tasks? 

a . Yes 

b. Somewhat 

c . No 

If "No/* please specify the task(s) 



In general f were the tasks appropriate to the maturational level 
of the students? 

a. Yes 

b . Somewhat 

c . No 

If ''No/* please specify the task(s) 



Ilov; v/ould you rate the flow or integration of the tasks with each 
other? 

a. Very Good c. Average d. Poor e. Very 

Good Poor 

Did you have any particular breaks in flow? 

a. Yes 

No 

If "Yes," please specif y^ ^ 



How would you rate student understanding of task directions and/or 
task materials? 

a* Very b. High c. Medium d. Low e. Very 

High . Low 
If "Low/* or "Very Low," please specify 



Did the students have any major problems in implementing the tasks? 

a. Yes 

b • Somewhat 

c* No 

If "Yesy" please specify 
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7. Please record any strengths and/or weaknesses you observed while 
working on this part of the simulation module: 



SUMMARY PHASE 

8. How would you rate the effectiveness of the Summary Phase in pro- 
viding a reasonable culmination ^ i.e.^ in tying together concepts ^ 
roles ^ ['etc. presented in the module^ to the simulation experience? 

o. Very b. High c. Medium d. Low e. Very 
High Low 

? . To what extent was the Summary Phase integrated with the immedi- 
ately preceding activities or tasks? 

a. Very b. Well c. Average d. Poorly e. Very 
Well Poorly 

10. How would you rate the effectiveness of the Summary Phase in 
helping students learn about occupational roles performed by 
others in the simulation? 

a. Very b. Somewhat c. Not 

Effective Effective Effective 

11, How useful do you feel the Summary Phase would be in helping 
students to make decisions about participation m other occupa- 
tional exploration activities ^ i.e.^ other simulation modules ^ 
etc.? 

a. Very b. Somewhat c. Not 

Useful Useful Useful 

12* Please record any strengths and/or weaknesses you observed while 
working on this part of the module: 
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OVERALL PERCEPTIONS 
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TEACHER BACKGROUND 



13* In what kind of group setting (e.g., English classroom, math 
classroom, students from study hall, students from a guidance 
group, etc.) and at what grade level did you introduce this 
simulation? 

a. Group Setting (please specify) 

b. Grade Level (please specify) 



14* Have you had any previous experience with simulation as an 
instructional technique? 

a. Yes, as a teacher 

b. Yes, as an observer 
c* Yes, as a participant 
d. No 

15. If you answered yes to question 14, briefly describe the 

nature and extent of your previous experiences with simulation 
If your response to question 14 was "No", please proceed to 
qv est ion 16. 

a. My previous experiences with simulation include 



16. Which of the following statements best describes your reasons 
for participating in the pilot test of this simulation module? 

a. Wanted to try out new ways of organizing instruction for 
students 

b* Have an interest in Career Education 

c. Thought material was of value for students 

d. Have a general interest or curiosity 

e. I was requested to participate 

.f. Other, or some combination of the above (please specify) 
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STUDENT BACKGROUND 



17. How were stud^i.;:s selected to participate in the simulation? 

a* Students volunteered from the class 

b* The class ^ rather than the students, volunteered 

c. Student volunteers from a study hall 

d. Other y please specify 



18* If you had volunteer students participating in the simulation, 

which of the following reasons best describes your perception 

of why they participated? If you did not have any volunteer 
students, please proceed to question 19. 

^. Interest in trying somethi.ng new 

b. Interest in particular area simulated 

c. Interest in careers 

d* Interest in just getting out of class or study hall 

e. Other, or some combination of the above (please specify) 



f , I can't really guess at the reason (s) 

19» Indicate any special characteristics of this class, e.g., many 
slow readers in class; many students with exceptionally good 
verbal skills; etc., which may bias the results of the pilot 
cest of this module. Also, describe how you feel the results 
will be biased by these characteristics. 

a* Characteristics Biases Produced 



b^ No special characteristics 
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IMPLEMENTATION OF THE MODULE 

20. How well did the in-service training prepare you to work with 
the module? 

a. Very b. Well c. Somewhat d. Poorly e. Very 
Well Poorly 

21. Did the in-service training provide you with a general under- 
standing of your role in the module implementation? 

a. Yes 

b. Somewhat 

c. No m ^ 

If "No/' please specify 



22. While working with this module, did you have to allot (or spend) 
more time than you normally would for preparation lexclude the 
time spent in in-service training)? 

Yes, specify additional time in hours 

b. Some extra time was necessary 

c. No extra time was necessary 

?.3. How sizable was the job of managing/coordinating (helping 

students y keeping track of materials) this simulation module 
for you? 

a . V er y b . About c . No t 

Sizable Average Sizable 



A DEQUACY OF EVALUATION MATERIALS 



24. Do you feel that the knowledge (What do you know?) and the atti- 
tude (What do you like?) tests were adequate measures of the 
material contained in the module? (Answer both parts of the 
question. ) 

Knowledge Test Comments Attitude Test Comments 

a. Yes a. Yes 

b. Somewhat b. Somewhat 
C. No C. No 

25. To what extent was the knowledge test difficult for students? 

a. Very b. Difficult c. About d. Easy e. Very 
Difficult Average Easy 
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STUD ENT UNDERSTANDING I INTEREST i ANC PARTICIPATION 



26. In general, were the directions in the module clear enough for 
students to understand what was expected of them? 

a. Very b. Clear c. Average d* Unclear e. Very 

Clear Unclear 

27. In general, was the vocabulary consistent with the maturational 
level of the students in the simulation? 

a. Yes, most b. Yes, some c. No, not much d. No ^ none 
of it of it of it of it 

2B. Did your students experience problems with the reading level of 
this module? 

a. Yes, many b. Yes, some c. Yes, but few d. No 

problems problems problems problems 

29. To what extent do you feel students were receptive (interested 
in- excited by) to simulation as a way of: learning? * 

w. Very b. Receptive c. Average d. Non- e. Very non- 
Receptive Receptive Receptive 

30. To what extent do you feel that students were receptive (interested 
in, excited by) to the content of this particular module? 

a. Very b. Receptive c. Average d. Non- e. Very non- 
Receptive Receptive Receptive 

31. Was there any change in student interest or motivation as they 
progressed through the module? 

a. Ygs 

b. Somewhat 

c. No ' 

If "Yes," interest changed as follows 



32. Do you feel that this module reinforced or helped to build the 
student's ability to make decisions? 

a. Yes 

b . Somewhat 

c . No 

d. Don't know 

If "Yes," Please specify how_ 
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33 • In your judgment, how much did the students learu about the 
process of simulation (role playing, problem solving, group 
interaction , etc . ) 

a. Very b- Much c. An average d. Little e. Very 
Much amount Little 

34, In your judgment, how much did students learn about the content 
of the module? 

a. Very b. Much c. An average d. Little e. Very 
Much amount Little 

35. Are there any students or groups of students (e.g., some students 
may have difficulty working in small self -directed groups) that 
you feel would have difficulty in participating in simulated types 
of experiences? 

a. Yes 

b. No 

If "Yes," please specify 



36, For what grades would you consider this module to be appropriate? 

a» 10th or b. 9th c. 8th d. 7th or e- Other 
higher lower 

57. Ideally, how many students should participate in this module? 

Number of students 



33. In general, did this module change the working relationships 

(personal interactions) between you and participating students? 

a. Yes 

b. Somewhat 
c • No 

If "Yes," or "Somewhat," the relationship changed as follows 
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OVERALL PERCEPTIONS AND RECOMMENDATIONS 



39. Overall, how would you rate the quality of the module? 

a. Very b. Good c. Average d. Poor Very 
Good Poor 

40. If possible, would you use this module with students again? 

a. Yes, with no modifications 
b* Yes, with minor modifications 

c. Yes, with major modifications 

d. No 

Please conunent, if you wish 



Would you recommend this module to ether teachers? 

a* Yes 
b- No 

Please give your reason (s)^ 



42* Were the main ideas and themes presented with logical consistency 
in the content of the module? 

a . Yes 

b ♦ Somewhat 

c • No 

If "No," please specify where the problems occurred 



43- All factors considered, which specific set of materials would 
you rate as the best? 



44 • All factors considered, which specific set of materials would 
you rate as the worst? 



45* Add as many comments and/or suggestions for revision of the 
module as you might have. 
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APPENDIX D: 



Observer Form 
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SIMULATION OBSERVERS FOR M - A 



This instrument is designed to obtain samples of on-going classroom 
behavior of students using simulation modules. These modules are being pilot 
tested as a part of the Occupational Exploration Program by the Center for 
Vocational and Technical Education at The Ohio State University and the Jefferson 
CouPity Public Schools. 

The observation form is made up of a set of three sheets. Each set contains 
foui- parts: the heading, media section, general comments and the interaction and 
activl'ties section. An observation form set is to be used for each period that 
is observed. The parts of each set are discussed below. 



The heading simply identifies the time, place, observer and the portion of 
I oaule that was observed. For ease of completion, the observer's namej> school^ 
oJid rriodule have been given a number code. Simply circle the appropriate number 
accordixig to the code below: 

Observer: Numbers will be assigned 

School: 1. Alameda Junior High 

2. Hamilton Junior High 

3. Lake Junior High 

U. Wheat Ridge Junior High 

Module: 1. Communications 

2. Product Services 

3. Insuraiice 

U. Health 8c Welfare 



Date: 



Indicate the date of the observation 



Activity or 
Activities : 



Indicate either the title of the activity i.e. "Preview" 
"Summary" or the number i.e. "Task 3" etc. Several 
spaces are provided in the event that more than one task 
or activity takes place in one period. 



1. Media 

The media section has two spaces that should be completed each time the 
pupils use some form of media. In the space following the type of media used, 
place a check (^) each time the media is used. For each (y), the number of 
students using that form of media should be indicated in the No. of Students 
Column. (See sample). 




2* General Comments 



The general comments section is designed to capture comments that c^o net 
lend themselves to the other categories • Two categories that are of continuing 
interest is the amount of time spent by pupils getting ready to start and the 
aflKDUnt of time cleaning up and getting ready to leave. You will note that these 
categories ere pre-printed on the observation forra# (Examples of general comments 
of interest appear on the saznple form). 



3* Interaction & Activities 

This section is designed to provide several kinds of information: 

a. How ft:equently do certain categories of events occur? 

b. What size group were the students in during the event? 

c. Vfhat were the circumstances surrounding the event? 
and in some instances: 

d. How long did the event last? 



Tha procedure for this section is as follows: Each time one of the events 
iu either the student or teacher activity columns occurs record an arable number 
in either the total group or sub-group column. (The total group column is 
appropriate when all of the students* ?re working together). (The small group 
coliiTJi is appropriate when the students are working individually or in two or 
racTe groups). Begin with number 1 each period; then number the events consecutively 
tliroughout the period. The comment section is provided in order that a very 
brief cnaur.ent or key word may be used to explain each arable number. (See example). 
NC>T£: The events for the entire period should be numbered consecutively even 
thlugh they are scattered between categories a through f. This system will allow 
the evaluation staff to reconstruct what happened during each period. 

If a number of questions about the same thing occur in category a, the 
minibers may be bracketed as is shown in the sample. Also if a number of questions 
fellow each other, it is of interest how long the questioning took. (Again see 
the example). 
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Explanation of Sample Form 



Heading , This form was completed ty observer number 2 at Alameda Junior 
High on Task 1 of the Communications Module, March 21, 197^. Eight pupils were 
present the day of the cbservation. 

Media Section , 

During the observation period, the students used two media forms in Tasks 
1 & 2, They begem with the sound/slide presentation, switched to the booklet, 
and finally used the booklet as they began Task 2, The media in each instance 
was used by the total group. 



I'S.-e ral Comments , 

Some of the general comments relate to other parts of the observation form 
ir ^' »^ ^«jnple, others are simply given as examples of the kinds of comments that 
a ^\it be Lippropriate. Note that it took the students 5 minutes to get started 
a.nd 3 minutes to get ready to leave, 

Tne comment space is designed to capture ycur overall impressions of special 
or noteworthy events occurring during the period. 



Interaction and Activities Section , 

T:\ic section provides a sequential history of what happened during the 
period, By reading the Arabic numbers and comments in orOer, the sample allows 
foliowing reconstruction of events, 

1, The pupils began as intended by viewing the slidt tape as a 
total group, 

2, Someone asked for help with the slide tape machine, 

3« As the teacher helped with the machine, other students began 
to "horse around", 

^, The teacher, discovering the machine was broken, directed the 
pupils to use the booklet instead, 

5. Teacher stopped the horseplay and redirected the actions of 
the miscreants, 

6. A pupil asked for help in finding a booklet, 
?• A pupil did not understand the booklet. 
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8, 9> 10, 11» A number of questions were asked regarding what 
should be done following the booklet • 5 minutes 
were consumed* 

12* The pupils broke up into groups at this point. (The observer 
is now focusing on one of the groups only). 

13* The teacher redirected the leader to his proper group. 

1^# The small group assembled & began to discuss their task as 
intended* 

15 • The task was completed, the product (a report in this instance) 
was completed • The total group moved on to Task 2 as the time 
came to begin the cleanup/put-away procedure. 



Footnotes 

Obviously all that transpired during the period was not recorded • No 
observer should feel they must capture every single event or question. With 
e:<perience and through use of the flow chart for the module being observed, 
obiiervers will become increasingly capable of capturing the more significant 
questions, events, etc# 

Should questions arise, do not hesitate to contact John Radloff, Jeffco 
Caz-eer Education Office - i+23-7010. 
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